Papers with explanation method
Considering Likelihood in NLP Classification Explanations with Occlusion and Language Modeling (2020.acl-srw)
Copied to clipboard
| Challenge: | Existing explanation methods produce invalid or syntactically incorrect data, neglecting the improved abilities of recent NLP models. |
| Approach: | They propose an explanation method that combines occlusion and language models to sample valid and syntactically correct replacements with high likelihood, given the context of the original input. |
| Outcome: | The proposed method can sample valid and syntactically correct replacements with high likelihood, given the context of the original input. |
Evaluating neural network explanation methods using hybrid documents and morphosyntactic agreement (P18-1)
Copied to clipboard
| Challenge: | a number of post hoc explanation methods for deep neural networks have been proposed . due to the complexity of the DNNs they explain, these methods are necessarily approximations and come with their own sources of error. |
| Approach: | They propose two evaluation paradigms that cover two important classes of NLP problems . they propose LIMSSE, LRP and DeepLIFT as the most effective explanation methods . |
| Outcome: | The proposed methods are most effective for explaining deep neural networks in NLP . the proposed methods can explain complex models without manual annotation . |
Logic Traps in Evaluating Attribution Scores (2022.acl-long)
Copied to clipboard
| Challenge: | Modern deep learning models are notoriously opaque, which has motivated the development of methods for interpreting how deep models predict. |
| Approach: | They propose to review existing methods for evaluating attribution scores and summarize the logic traps in these methods. |
| Outcome: | The proposed methods show that they do not contain logic traps and that they are not reliable. |
HOTTER: Hierarchical Optimal Topic Transport with Explanatory Context Representations (2021.findings-emnlp)
Copied to clipboard
Sabine Wehnert, Christian Scheel, Simona Szakács-Behling, Maret Nieländer, Patrick Mielke, Ernesto William De Luca
| Challenge: | Natural language processing (NLP) is often the backbone of today’s systems for user interactions, information retrieval and others. |
| Approach: | They propose an extension to a specific emerging hybrid document distance metric which combines topic models and word embeddings. |
| Outcome: | The proposed method is competitive on public datasets and the language model BERT is used for a document categorization task. |
BERT-Beta: A Proactive Probabilistic Approach to Text Moderation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to text moderation are reactive and do not account for user generated content. |
| Approach: | They propose a text toxicity propensity model to characterize extent to which a user generated text attracts toxic comments and introduce a beta regression model to do the probabilistic modeling. |
| Outcome: | The proposed model performs well in comprehensive experiments and is scalable. |
Discovering Biases in Information Retrieval Models Using Relevance Thesaurus as Global Explanation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Currently, local explanations are not effective in predicting the model’s behavior on unseen texts. |
| Approach: | They propose a method to build a relevance thesaurus containing semantically relevant query term and document term pairs which can augment BM25 scoring functions to better approximate the neural model’s predictions. |
| Outcome: | The proposed method can augment BM25 scoring functions to better approximate the neural relevance model’s predictions. |